Some Specialized Comparison Techniques for Doubly Stochastic Finite Markov Chains

نویسنده

  • Martin Hildebrand
چکیده

This paper considers certain comparison techniques involving Markov chains with transition matrices Pa = aI+(1?a)P where P is the transition matrix of a doubly stochastic Markov chain. This paper provides upper bounds for how far the Markov chain with transition matrix Pb is from uniformly distributed after n steps. These upper bounds involve how far the Markov chain with transition matrix Pa is from uniformly distributed after m steps and probabilities involving binomial random variables, m, n, a, and b. These upper bounds are provided for cases where b > a and for cases where b < a. The paper also provides an example involving random walks on nite groups where the result in the case b < a is useful.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Stochastic Comparison approach for Stochastic Model Checking

Stochastic model checking requires the computation of steady-state or transient distribution for finite or infinite Markov chains for the evaluation of some formulas implying probabilities. However the numerical analysis of Markov chains is much less efficient than the sophisticated algorithmic techniques such as MTBDD developed for the deterministic model checking. We propose to simplify the n...

متن کامل

Relative Entropy Rate between a Markov Chain and Its Corresponding Hidden Markov Chain

&nbsp;In this paper we study the relative entropy rate between a homogeneous Markov chain and a hidden Markov chain defined by observing the output of a discrete stochastic channel whose input is the finite state space homogeneous stationary Markov chain. For this purpose, we obtain the relative entropy between two finite subsequences of above mentioned chains with the help of the definition of...

متن کامل

A class of quasigroups solving a problem of ergodic theory

A pointed quasigroup is said to be semicentral if it is principally isotopic to a group via a permutation on one side and a group automorphism on the other. Convex combinations of permutation matrices given by the one-sided multiplications in a semicentral quasigroup then yield doubly stochastic transition matrices of finite Markov chains in which the entropic behaviour at any time is independe...

متن کامل

Stochastic Dynamic Programming with Markov Chains for Optimal Sustainable Control of the Forest Sector with Continuous Cover Forestry

We present a stochastic dynamic programming approach with Markov chains for optimal control of the forest sector. The forest is managed via continuous cover forestry and the complete system is sustainable. Forest industry production, logistic solutions and harvest levels are optimized based on the sequentially revealed states of the markets. Adaptive full system optimization is necessary for co...

متن کامل

ENTROPY FOR DTMC SIS EPIDEMIC MODEL

In this paper at rst, a history of mathematical models is given.Next, some basic information about random variables, stochastic processesand Markov chains is introduced. As follows, the entropy for a discrete timeMarkov process is mentioned. After that, the entropy for SIS stochastic modelsis computed, and it is proved that an epidemic will be disappeared after a longtime.

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2000